Skip to content

omnigres/omnigres

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Omnigres: We want back to the drawing board

Documentation | Bounties


Discord Chat Documentation License

Omnigres makes Postgres a developer-first application platform. You can deploy a single database instance and it can host your entire application, scaling as needed.

  • Running application logic inside or next to the database instance
  • Deployment provisioning (Git, containers, etc.)
  • Database instance serves HTTP, WebSocket and other protocols
  • In-memory and volatile on-disk caching
  • Routine application building blocks (authentication, authorization, payments, etc.)
  • Database-modeled application logic via reactive queries
  • Automagic remote APIs and form handling
  • Live data updates

Blogs and Publications

πŸƒ Quick start

The fastest way to try Omnigres out is by using its container image:

docker volume create omnigres
docker run --name omnigres --mount source=omnigres,target=/var/lib/postgresql/data \
           -p 127.0.0.1:5432:5432 -p 127.0.0.1:8080:8080 --rm ghcr.io/omnigres/omnigres:latest
# Now you can connect to it:
psql -h localhost -p 5432 -U omnigres omnigres # password is `omnigres`

Postgres parameters such as database, user or password can be overridden as per the "Environment Variables" section in postgres image instructions

You can access the HTTP server at localhost:8080

Building your own image

If you can't use the pre-built image (for example, you are running a fork or made changes), you can build the image yourself:

# Build the image
DOCKER_BUILDKIT=1 docker build . -t ghcr.io/omnigres/omnigres

Download omnigres extensions

Omnigres extensions can also be downloaded and installed in any postgres installation with file system access.

πŸ‘‹ "Hello, world"

Here we expect you are running the container image, which has omni_httpd and omni_web extensions provisioned by default.

Let's start with a traditional example. Here we will instruct the handler that is provisioned by omni_httpd by default to use the enclosed query to greet the world.

Below, we'll show examples in Python and plain SQL (or PL/pgSQL). Support for more languages is coming!

$ curl localhost:8080
Hello, world!
Python (Flask) implementation
from omni_python import pg
from flask import Flask
from omni_http.omni_httpd import flask

app = Flask('myapp')


@app.route('/')
def hello():
    return "Hello, world!"


handle = pg(flask.Adapter(app))

To connect the endpoint:

update omni_httpd.handlers
set
    query =
        $$select handle(request.*) from request$$;

NB: Please note that you will need to follow Python setup steps for the time being before our CLI tooling is ready.

Plain SQL

You can also achieve the same using plain SQL with very little setup.

update omni_httpd.handlers
set
    query =
        $$select omni_httpd.http_response('Hello, world!') from request$$;

Now, let's make it more personal and let it greet the requester by name.

$ curl "localhost:8080?name=John"
Hello, John!
Python (Flask) implementation
from flask import request  # we need to access `request`


@app.route('/')
def hello():
    return f"Hello, {request.args.get('name', 'world')}!"
Plain SQL
update omni_httpd.handlers
set
    query =
        $$select omni_httpd.http_response('Hello, ' || 
                   coalesce(omni_web.param_get(request.query_string, 'name'), 'world') || '!')
          from request$$;

This, of course, only barely scratches the surface, but it may give you a very high-level concept of how Omnigres web services can be built.

For a more complex example, that uses the underlying database and employs more real-world layout, check out this MOTD service example.

πŸ—οΈ Component Roadmap

Below is the current list of components being worked on, experimented with and discussed. This list will change (and grow) over time.

Name Status Description
omni and Omni interface βœ… First release candidate Advanced adapter for Postgres extensions
omni_schema βœ… First release candidate Application schema management
omni_id βœ… First release candidate Identity types
omni_aws βœ… First release candidate AWS APIs
omni_json βœ… First release candidate JSON toolkit
omni_yaml βœ… First release candidate YAML toolkit
omni_xml βœ… First release candidate XML toolkit
omni_http βœ… First release candidate Common HTTP types library
omni_httpd, omni_web βœ… First release candidate Serving HTTP in Postgres and building services in SQL
omni_session βœ… First release candidate Session management
omni_mimetypes βœ… First release candidate MIME types and file extensions
omni_httpc βœ… First release candidate HTTP client
omni_sql 🚧 Extremely limited API surface Programmatic SQL manipulation
omni_vfs β˜‘οΈ Initial prototype Virtual File System interface
omni_containers β˜‘οΈ Initial prototype Managing containers
omni_manifest β˜‘οΈ Initial prototype Improved extension installation
omni_types βœ… First release candidate Advanced Postgres typing techniques (sum types, etc.)
omni_seq βœ… First release candidate Extended Postgres sequence tooling
omni_var βœ… First release candidate Variable management
omni_txn βœ… First release candidate Transaction management
omni_python β˜‘οΈ Initial prototype First-class Python Development Experience
omni_regex βœ… First release candidate Feature-rich regular expresssions
omni_os β˜‘οΈ Initial prototype Access to the operating system
omni_polyfill βœ… First release Provides polyfills for older versions of Postgres
omni_git πŸ₯Ό Early experiments (unpublished) Postgres Git client
omni_reactive πŸ—“οΈ Haven't started yet Reactive queries

⌨️ Hacking

Building & using extensions

To build and run Omnigres, you would need:

  • a recent C compiler
  • OpenSSL 3.2 (optional, will be built if not available)
  • cmake >= 3.25.1
  • (optionally, to use omni_containers or run a full set of tests) a recent version of Docker
Dependencies for Fedora
  • Packages: git cmake gcc g++ cpan openssl-devel openssl-devel-engine python-devel openssl bison flex readline-devel zlib-devel netcat
  • CMake flags: -DOPENSSL_CONFIGURED=1
cmake -S . -B build
cmake --build build --parallel
make -j psql_<COMPONENT_NAME> # for example, `psql_omni_containers`

Troubleshooting

cmake not picking up Python version you want?

To use a specific Python build use the cmake flag Python3_EXECUTABLE:

cmake -S . -B build -DPython3_EXECUTABLE=/path/to/python
Build fails for whatever other reason?

Remove build and .pg directories for a clean rebuild:

rm -rf .pg build

Running tests

# in the build directory
CTEST_PARALLEL_LEVEL=$(nproc) make -j $(nproc) all test